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THE  CONVERGENCE  OF  AN  INSTRUMENTAL- VARIABLE  LIKE  RECURSION 

V.  Solo 

X.  Introduction.  Recently  the  author  (Solo,  1979)  has  proved  the  convergence 
of  the  AML  recursion  (provided  a  certain  positive  real  condition  holds)  without 
requiring  the  recursion  be  monitored  -  i.e.  projected  into  a  stability  region 
should  it  become  unstable.  In  this  article  it  is  shown  there  is  another  recur¬ 
sion  that  converges  without  being  monitored  (but  provided  a  certain  positive 
real  condition  holds)  namely  a  modified  form  of  the  IV  ( Instrumental  Variable) 
recursion  of  Young  (1974,  1976). 

Consider  the  following  TFWN  (Transfer  function  white  noise)  model  which  is 
defined  by  a  formula  for  its  innovations  sequence  as 

e  (0)  =  y  -  s  (0)  =  y  -  (1+A(L) ) _1B(L)u 
n  —  n  n  n  n 

where  y^,  sn(*)*  un  are  observed,  output,  input  sequences  respectively  while 

B  (L)  =  Lb  b.L1 
L1  l 

etc.  and  L  is  the  lag  or  inverse  z  transform  operator.  Also  £  = 

(a^,...,a  b^,...,bn  )'  and  £  e  R  a  compact  subset  of  the  open  set 

a  nb 

S  =  {£  |  1+A ( L)  has  all  zeroes  outside  the  unit  (1) 

circle  in  the  complex  L  plane} 

It  is  assumed  there  is  a  true  value  9„  e  R  so  that  e  (0„)  (denoted  c  ) 

-0  n  -0  n 

is  a  nonlinear  innovations  sequence  (i.e.,  is  orthogonal  to,  or  uncorre¬ 

lated  with,  any  function  of  the  past  (of  e  )  linear  or  nonlinear) .  Thus 
E(e^  j  Fn_1)  =  0  where  ^  is  the  "history"  or  increasing  o-alqebras 

generated  by  e^:  is  also  called  a  martingale  difference  sequence.  It 
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2  i  r  ,  2 

is  also  assumed  e  has  a  constant  prediction  variance  i.e.,  EK  r  )  =  o  . 

n  n  n-1 

The  ergodicity  assumption  then  ensures 

-lrn  2  2 

n  ) ,  ■'  ->  a  a.  s .  (2) 

L1  k 

The  u^  sequence  may  be  deterministic  or  stationary  ergcdic  (independent 
of  the  sequence)  and  is  assumed  to  have  a  finite  non  zero  power 


0 


.  -lyn  2 
lim  n  llUk 


2 

o  <  00 

u 


(3) 


The  IV  recursion  for  9  is 


0  =  0  +  P  q  e 

-n  -n-1  — n  -n  n 


-1  o~l 

P  =  P  ,  +  q  z 
-n  -n-1  -n  -n 


or 


P 

-n 


P 

-n- 


1 


,  'f  z  ' 
-1  -n  -n 


P  ,/(l  +  <P' 
-n-1  -n 


P  ,  z  ) 
-n-1  -n 


e 

n 


y 


n 


s 

n 


where 


=  (-s  ,  . .  .-s  u  . . . -u  ) 

n-1  n-n  n-1  n-n, 
a  b 


s 

n 


-•f  ' 

-n 


e 

-n- 


1 


z  ' 
-n 


"^n-1 


n-1 


.  u 

n-nb 
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The-  so-called  symmetric  IV  recursion  replaces  z^  above  by  The  resulting 

recursion  can  also  be  obtained  by  applying  the  recursive  least  squares  algorithm 
directly  to  the  pseudo-regression 

e  (9)  =  y  -  s  (9)  =  y  -*'(0)0 
n-  n  n-  n  -n  -  - 

where  y-  (9)  =  ( —  s  ( Q )  .  .  .  -  s  (9)  u  .  ...u  )'.  Elsewhere  solo  (1978,1980) 

-n  -  n-1  -  n-n  -  n-i  n-n, 

a  b 
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the  author,  has  called  this  a  regression  recursion. 


In  Appendix  A  it  is  pointed  out  that  provided 


u^  is  persistently  exciting  of  order  n^  + 


(4a) 


then 


-lrn 


limn  li-VV4'(V 


(4b) 


is  positive  definite. 

Now  we  modify  the  symmetric  IV  recursion  in  much  the  same  way  that  AML  is 
a  modified  form  of  RML,  with  a  priori  quantities  replaced  by  a  posteriori  ones 
(see  Solo,  1979) .  Thus  introduce  the  recursion 


0  =0  _  +  P  'P  e 

-n  -n-1  -n  -n  n 


(5a) 


—  2.  —  1  A  A 

P  =  P  ,  +  p  p  ' 
-n  -n-1  -n  -n 


a  =  V  —  uj  1  9 

n  'n  -n  -n-1 


(5b) 

(5c) 


where 


and 


<p  '  -  (-s  .. . . .  -s  u  .  •  •  •  u  ) 

-n  n-1  n-na  n“l  n_nb 


s  =  >P  '  0 
n  -n  -n 


( 5d) 

(5e) 


The  a  posteriori  residual  is 


h  =  yra 

n  n 


s  =  y 
n  n 


P  '  6 

-n  -n 


(5f) 


Also 


^e=e(l-ip'p  <p  )  .  ( 5g) 

n  n  -n  -n-1  -n  -n  -n  n  n  -n  -n  -n 


It  is  assumed  that  the  recursion  is  initialised  so  that  P  1  is  positive  definite 

-P 

(p  =  n&  +  n^)  then  by  (5b)  P^  is  positive  definite  for  all  n  >_  p .  This 
recursion  will  be  called  an  aposteriori  regression  recursion  (denoted  by  RR+) : 

AML  of  Solo  (1979)  is  also  an  RR+.  The  remainder  of  the  paper  is  organized 
as  follows:  Section  II  contains  the  proof.  Section  III  contains  some 


conclusions.  There  is  one  Appendix.  In  the  sequel  the  Appendices  of  Solo 
(1979)  (henceforth  denoted  S)  will  be  referred  to.  Appendix  I  contains  a 
Martingale  convergence  theorem  (MGCT*)  as  well  as  some  consequences  of  the 
Matrix  Intersion  Lemma  (MIL).  Appendix  II  discusses  the  positive  real  lemma. 
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II .  Proof  of  Convergence 

(a)  Preliminaries.  The  structure  of  the  proof  is  briefly  outlined.  It  is 
similar  to  that  in  S:  there  are  three  stages.  Firstly  consider  the  follow¬ 
ing  stability  property  of  this  RR,  recursion.  In  (5a)  form  6  '  P  1  6  and 

+  -n  -n  -n 

sum  up  (cf  S,  eq  (13a))  then  use  (5g)  to  find 


e  '  p-1  e  +  l1}  n"1  /(i  -  *  •  p.  i.)  = 

-n  -n  -n  L1  k  -k  -k  -k  ^1 


Now  (1) ,  (2) ,  (3)  and  the  assumption  that  0Q  e  R  ensure 


t-t-  -1  rn  2 
lim  n  sk 


r-r—  -1  rn  2 
lim  n  2-!  y. 


Thus,  since  via  MIL  (A3)  of  S,  1  -  P^  ^  <  1  (this  follows  since  by  con¬ 
struction  P  is  positive  definite  while  y  =  »,  u  =  °°  are  zero  probability 

“*K  K  K 

events)  we  conclude 


7T—  -1  rn  2 

lim  n  n 


<  »  a. s . 


and  also  via  (5g) 


— : —  -1  yn  "2 

limn  ) .  s,  <  °°  a.s. 

‘•I  k 


Thus  purely  because  a  posteriori  quantities  are  used  the  recursion  never  becomes 
unstable  in  that  the  power  in  the  forecast  errors  is  bounded. 

The  second  stage  in  the  proof  is  to  suppose  a  strict  positive  real  condi¬ 
tion  for  h(L)  =  (1+Aq(L))  1  namely 


for  some  small  6  >  0  ,  Re  h(e  )  >  6 


This  will  yield  via  (8)  and  the  Martingale  Convergence  Theorem  (MGCT*) 
. .  - 1  rn  2 

lim  n  ~  ek)  =  0  a.s. 


(0n  "  V  ’  Pn1(0n  ~  »«>/"  **>  0  a.S. 

-n  -0  -n  -n  -0 


-5- 


Thus  the  addition  of  (9)  to  the  assumptions  (1),  (2),  (3)  and  0Q  c  R  yields 
an  improvement  of  (8)  to 


lim  n 


-1 


r 


\  =  ° 


(10c) 


This  follows  from  (10a),  (2)  and  the  Cauchy- Schwarz  inequality.  Next  observe 
that  since  =  y^  -  s^_  =  +  Sj_  -  s^  (10a)  can  be  rewritten 

-1  vn ,  *  .  2 

n  _  sk)  -*•  0  a.s.  (lOd) 

Now,  however,  it  follows  that 

n^P^'+R  a.s.  (lOe) 

-n  — 


To  see  this  it  is  only  necessary  to  show 
-1  rn  * 

n  )  ( s,  -  s,  )  u,  -+■  0  r  =  1 .  .  n  ;  s  =  1 . .  n. 

As  k-r  k-r  k-s  a  b 


n  1  yn(s,  -  s,  )  s.  0  r  =  l..n 

k  k  k-r  c 


where  r  a  s  =  min(r,s).  But  these  follow  via  the  Cauchy-Schwarz  inequality 
from  (10c) ,  (3),  (7a)  and  the  fact  that  (3)  and  (7a)  imply 

2  2 

u^/n  -»■  0  ,  s^/n  -+  0  respectively 


(This  follows  from  MIL  (A5)  Of  S:  put  x  =  u  and  then  x  =  s  .) 

-n  n  -n  n 

For  the  final  stage  of  the  proof  observe  that  the  persistently  exciting 
condition  (4a)  ensures  R  is  positive  definite.  Then  (10b) ,  (lOd)  yield 

9n-90  a.s.  (11) 

We  now  proceed  to  fill  in  the  details  of  the  proof. 

Remark.  It  will  also  follow  as  in  S  that  n  ^  in  (10a)  can  be  replaced  by 
n  J  for  some  small  v  >  0.  Also  (11)  can  be  improved  to 
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1 

2~V 

n  (6  -  0„)  ->  0 

-n  -0 


a.s. 


(b)  Proof  details.  Rewrite  (5a)  as 


0  =6  ,  +  P  'P  n 

-n  -n-1  -n-1  -n  n 


This  follows  from  (5g)  and  from  MIL  which  implies 

P  <P  e  =  P  ..  <fi  e  /(I  +  $  '  P  $  ) 
-n  -n  n  -n-1  -n  n  -n  -n  -n 


=  P  .  e  (1  -  »>  1  P  0  ) 

-n-1  -n  n  -n  -n  -n 

Next  denote  T  =  (0  -  0,.)  'P  \  (0  -  0.)  and  rewrite  (12a)  as 

n  -n  -0  -n-1  -n  -0 


p  \  (0  .  -  0.)  =  p”1,  (0  -  0.)  -  *  n 

-n-1  -n-1  -0  -n-1  -n  -0  -n  n 


Then,  an  easy  calculation  shows 

t  =  T  -  (<?  ’  (0  -  @A) ) 2  -  2n  (0  -  0  J  +  i  '  P  ,  <?  n2 

n-1  n  -n  -n  -0  n  -n  -0  -n  -n  -n-1  -n  n 


Next  consider  that 


s  =  i p'Q 
n  -n  -0 


s  =  <p  '  0 
n  -n  -n 


where  s  =  s  (0„)  and  s®  =  s®  (0.)  .  Thus 
n  n  -0  -n  -n  -0 


or 


s  -  s  =  -A  ( L) (s  -  s  )  -  ' (6  -  0n) 

n  n  0  n  n  -n  -n  -0 


d  +  A0(L))(sn  -  Sn)  =  -  *_n’(0n  -  0Q) 


However  n  -  £  =y  -2  -  e  =  s  -s 

n  n  n  n  n  n  n 


so 


(1  +  A  (L))  (n  -  e  )  =  -  *  '  (0  -  6  ) 

0  n  n  -n  -n  -0 


(12a) 


(12b) 


(13) 
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Letting  u,y  be  generic  symbols  for  input/output  sequences  respectively  call 


u  =  '  (0  -  0n) 

n  -n  -n  -0 


y„  =  nn  "  +  \  “  6n> 

n  n  n  2  -n  -n  -0 


1  - 


Thus  (1  +  AQ(L))(yn  +  j  un>  =  or 


vn  ■  "i  ♦  v01"1  -  iiin  . 


Now  express  (12b)  in  terms  of  y  ,  u  ;  note  from  MIL  (A3)  that 

n  n 


<fi  '  P  .  =  <fi  '  P  i P  /(I  -  '  P  'f  ) 

-n  -n-1  -n  -n  -n  -n  -n  -n  -n 


and  observe  that  e  -  e  depends  only  on  history  up  to  time  n-1  (i.e.,  is 

n  n  '  ’ 

F  measurable) .  Then  taking  conditional  expectations  yields  (cf  S) 


£(T  +  2u  ylF  )  <  T  +  2o  £  '  P  <fi 

n  n  n  n™* 1  n  1  n  n  — n 


(14a) 


Zn  *  * 

,  u,  y,  .  Then  according  t.o  the  strict  positive  real 
1  k  k 

assumption  (9)  there  is  a  constant  c  depending  only  on  initial  conditions 


sucn  that 


c  =  c  +  c 
n  n 


>  2  6  ^  >  0 
—  ‘-Ik  — 


(15) 


(see  Appendix  II  of  S) .  Thus  in  (14a)  denoting  T  '  =  Tn  +  cn 


E(T  '  I F  ,  )  <  T'  +  2a  '  P  ip 
n  n-r  —  n-1  -n  -n  -n 


(14b) 


Now  we  could  proceed  as  in  S  by  dividing  by  n:  here,  however,  a  slightly 

different  route  is  taken.  Divide  through  (14b)  by  r  =  tr(P  S . 

n  -n 

E(T  '/r  !F  . )  <  T'  /r  -  (T*  /r  )dr  /r  +  2o2  '  P  *  /r 

n  n'  n-1  —  n-1  n-1  n-1  n-1  n  n  -n  -n  -n  n 
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where  dr  =  r  - 
n  n 

rn-l: 

notice  that 

r 

n 

is 

Fn-1  ' 

Now  bearing 

in  mind 

MGCT*  consider 

oCO  ^ 

ip  «»• 

-n  *n/rn  =  l 

.00  " 

p  -n 

P 

-n 

P*"1  P 
-n  -n 

<1 

’CO  O 

^  ^  ' 
p  -n 

P2 

-n 

% 

<  CO  by  MIL 

(A4) 

Thus  according  to  MGCT* 


T  '/r  =  (T  +  c  )/r  converges  a.s. 

n  n  n  n  n  ^ 


r°° 

)  (T'  ,/r  )dr  /r  <  »  a.s. 
Lp  n-1  n  n  n 


Next  observe  that 


=  tr(P  I)  =  In  'f.  '  >  ln  u 

n  -n  Lp  -k  -k  Lp 


n  2 


P  k 


\  CO 


Thus 


so  we  conclude 


r-iOO 

y  dr  /r 
Lp  n  n 


T  '/r  =  (T  +  c  )/r  0 

n  n  n  n  n 


a.s. 


Now  observe  by  (3) ,  (8b)  that 


Thus 


lim  r  /n  <  00 
n 


lim  T  ' /n  <  lim  T  ' /r  lim  r  /n  =  0 
n  —  n  n  n 


Now  positivity  of  T  ,  c^  implies  (10b) 


T  /n  -*•  0 
n 


or 


c  /n  ->  0 
n 


2"  \  Vn  "  0 
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(16) 


4 


whereupon  condition  (9),  via  (15)  yields 


Also  the  stability  of 


h(L)  implies,  (as  in  S,  eq.  (18)) 


II 


- 2 


u 


k 


so  (17a)  implies 


rn  -2  . 

Il  yk/n  -  0 


1  „ 

Finally  since  n,  -  e,  =  v,  +  —  u,  we  obtain 
k  k  k  2  k 


-1 

n 


i;<\  - 


v 


0  . 


The  proof  is  complete. 


(17a) 


(17b) 


(10a) 


Conclusions .  It  has  been  shown  that  provided  conditions  (1),  (2),  (3),  that 
0Q  e  R  =  S  of  (1) ,  (4a)  and  the  positive  real  condition  (9)  holds  then  the  a 
posteriori  Regression  Recursion,  for  the  parameters  of  a  TFWN  model,  converges 
without  the  need  of  monitoring.  This  is  a  rather  disappointing  result  in  that 
the  positive  real  condition  must  be  satisfied  by  a  quantity  that  depends  on  the 
system  characteristic  function.  Now  it  is  clear  that  the  original  IV  recursion 
could  not  be  expected  to  converge  unless  the  positive  real  condition  holds; 
further  even  if  this  holds  the  IV  recursion  would  in  general  not  converge  with¬ 
out  being  monitored.  At  least  in  that  respect  the  present  recursion  is 
superior.  Finally  it  may  be  remarked  that  in  the  off  line  case  it  it  well 
known  that  the  IV  estimator  (or  its  symmetric  form)  converges  even  if  r  is 
a  coloured  noise.  It  would  be  interesting  to  know  if  that  holds  too  with  the 
recursive  estimator. 
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Appendix.  Persistent  Exatation  and  Positive  Definiteness. 


The  aim  is  to  show  that  if  (4a)  holds  then  we  cannot  find  a  fixed  (n  +  n,  ) 

a  d 

vector  a  with  a'  R  a  =  0.  Suppose  there  is  a  vector  a_  with  a'  R  a  =  0. 
Partition  a  into  (a'Ei')  with  a  an  na~vector,  an  n^-vector :  also  form 


polynomials 


n  n 

ot  (L)  =  a.  L+.  .  .  L  ;  8(D)  =  8.  L+-  -  *  +8  D 
in  In, 

a  b 


Now  a'  R  a  =  0  implies 


Consider  that 


"'l  £k<»0>>2  -  o 


a'  £k(-o^  =  -Cl(L)sk  +  ®<L)uk 


at(L}6Q(L ) 

1+Aq(L)  Uk  +  B(L)uk 


1+A0(L)  k 


where  r(L)  =  -a(L) BQ(L)  +  (1  +  A Q(L))8(L).  Notice  that  r(L)  is  of  the  form 


n  +n 
a  b 

t,L+...+t  ,  L  .  Consider  that 

1  n  +n, 

a  b 


["(T(L)uk)2  =  l*  1  +  A0(L)  ^ 


1+AQ(L)  k 


iw  ,  |  2  vn  (  t  (L) 


(cf  S,  eq. (18) )  £  sup| 1  +  AQ (e  ) |  ^ 


1+AQ(L)  “k 


=  sup 1 1  +  A^e^)!2  £"(a’  '£k(60))2  • 


Thus  since  the  coefficients  of  A^(L)  are  bounded  (Al)  implies 

lim  n  1  ^(x(L)uk)2  =  0 

which  contradicts  (4a) . 
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